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Abstract —This paper adresses the statistical performance of 
suhspace DoA estimation using a sensor array, in the asymptotic 
regime where the number of samples and sensors hoth converge 
to infinity at the same rate. Improved suhspace DoA estimators 
were derived (termed as G-MUSIC) in previous works, and were 
shown to be consistent and asymptotically Gaussian distributed 
in the case where the number of sources and their DoA remain 
fixed. In this case, which models widely spaced DoA scenarios, 
it is proved in the present paper that the traditional MUSIC 
method also provides DoA consistent estimates having the same 
asymptotic variances as the G-MUSIC estimates. The case of DoA 
that are spaced of the order of a beamwidth, which models closely 
spaced sources, is also considered. It is shown that G-MUSIC 
estimates are still able to consistently separate the sources, while 
this is no longer the case for the MUSIC ones. The asymptotic 
variances of G-MUSIC estimates are also evaluated. 

Index Terms —Subspace DoA estimation, large sensor arrays, 
random matrix theory 


1. Introduction 

T he problem of estimating the directions of arrival (DoA) 
of source signals with an array of sensors is fundamental 
in statistical signal processing, and several methods have been 
developed and characterized in terms of performance, during 
the past 40 years. Among the most popular high resolution 
methods, subspace algorithms such as MUSIC [17] are widely 
used. It is well known (see e.g. [19]) that subspace methods 
suffer the so-called “threshold effect”, which involves a severe 
degradation when either the Signal to Noise Ratio (SNR) 
and/or the sample size are not large enough. In contrast, the 
threshold breakdown is less significant for Maximum Like¬ 
lihood (ML) techniques, and occurs for a much lower SNR 
and/or sample size. However, due to their reduced complexity 
since they involve a one-dimensional search over the set of 
possible DoA, subspace methods are usually prefered over ML 
which requires a multi-dimensional search. 

The study of the statistical performance of MUSIC al¬ 
gorithm has received a lot of attention, see e.g. [18], and 
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its behaviour has been mainly characterized in the situation 
where the number of available samples N of the observed 
signal is much larger than the number of sensors M of the 
array. However, there may exist some situations where this 
hypothesis is not realistic, for example when the number of 
sensors M is large and the signals have short-time duration 
or short time stationarity. In this case, M and N are of the 
same order of magnitude, and the standard statistical analysis 
of MUSIC is irrelevant. This is mainly because the sample 
correlation matrix of the observations, on which MUSIC 
mainly relies, does not properly estimate the true covariance 
matrix. In this context, the standard estimate of the MUSIC 
angular “pseudo-spectrum” does not appear to be consistent. 
To model this more stringent scenario, it was proposed in [13] 
to consider a new asymptotic regime in which both M, N 
converges to infinity at the same rate, that is 

M, N —>■ oo such that ^ c > 0. 

Based on results from random matrix theory, giving a precise 
description of the behaviour of the eigenvalues and eigen¬ 
vectors of large random matrices, an improved MUSIC DoA 
technique, termed as “G-MUSIC”, was derived in [13] in 
the unconditional model case, that is, by assuming that the 
source signals are Gaussian and temporally white. This method 
was based on a novel estimator of the “pseudo-spectrum” 
function. Other related works concerning the unconditional 
case include [9] as well as [10] where the source number 
detection is addressed. Later, [20] addressed the more general 
conditional model case, i.e. the source signals are modelled 
as non observable deterministic signals. Using an approach 
similar to [13], a different estimator of the pseudo-spectrum 
was proposed. More recently, the work of [23] extends the 
improved subspace estimation of [20] to the situation where 
the noise may be correlated in time. We also mention the recent 
series of works [4] [3] [5] on robust subspace estimation, in 
the context of impulsive noise. 

Experimentally, it can be observed that in certain scenarios, 
MUSIC and G-MUSIC show quite similar performance, while 
in other contexts G-MUSIC outperforms MUSIC. In this paper 
which is focused on the conditional case, we explain this 
behaviour and provide a complete description of the statistical 
performance of MUSIC and G-MUSIC. Roughly speaking, 
we prove that if the DoAs are widely spaced compared to 
MUSIC and G-MUSIC have a similar behaviour, while MU¬ 
SIC fails when the DoAs are closely spaced. More precisely, 
we establish the following results. 

• When the number of sources K and the corresponding 
DoA remain fixed as M, N ^ oo (a regime which 
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models widely spaced sources), we show that, while 
the pseudo-spectrum estimate of MUSIC is inconsistent, 
its minimization w.r.t. the DoA provides A^-consistent 
' estimates. Moreover, in the case of asymptotically 
uncorrelated source signals, the MUSIC DoA estimates 
share the same asymptotic MSB as G-MUSIC. 

• For two sources with an angular spacing of the order of 
a beamwidth, that is 0{M~^) as M,N —)■ oo, we show 
that G-MUSIC remains A^-consistent while MUSIC is not 
A^-consistent anymore, which means that MUSIC is no 
longer able to asymptotically separate the DoA. 


A. Problem formulation and previous works 

Let us consider the situation where K narrow-band and far- 
held source signals are impinging on a uniform linear array 
of M sensors, with K < M. The received signal at the output 
of the array is usually modeled as a complex M-variate time 
series (y„)„>i given by 

y„ = As„ -f v„, 

where 

• A = [a(6*i),..., Si{6K)] is the M x K matrix of steering 

vectors a(0i),...,a(0if), with 9i,...,6k the source 
signals DoA, and a{9) = ; 

• s„ € contains the source signals received at time n, 
considered as unknown deterministic ; 

• (v„)„>i is a temporally and spatially white circularly 
symmetric complex Gaussian noise with spatial covari¬ 
ance E[v„v*] = cr^I. 

By assuming that N observations yi,... ,yAr are collected in 
the M X N matrix 


Yat = [yi,... ,yAr] = ASat -I- Vat, (1) 

with Sn = [si,...,SAr] and Vat = [vi,..., v^v], the DoA 
estimation problem thus consists in estimating the K DoA 
9i,... ,9fc from the matrix of samples Yat. 

Subspace methods are based on the observation that 
the source contributions Asi,...,AsAr are conhned in 
the so-called signal subspace of dimension K, dehned as 
span {a(0i),..., a(0A')} ■ By assuming that the signal sample 
covariance A^^SatS^ is full rank, 9i,... ,9 k are the unique 
zeros of the pseudo-spectrum 

r,i9) = a(0)*na(0), (2) 


where 11 is the orthogonal projection matrix onto the noise 
subspace, defined as the orthogonal complement of the signal 
subspace, and which coincides in that case with the kernel of 
A^^ASatS^A* of dimension M — K. 

Since 11 is not available in practice, it must be estimated 
from the observation matrix Yat. This estimation is tradi- 
tionnaly performed by using the so-called sample correlation 
matrix of the observations (SCM) 


Y^Y^ 

A 


1 

A 


N 

n—1 


and n is directly estimated by considering its sample estimate 
XIat, i.e. the corresponding orthogonal projection matrix onto 
the eigenspace associated with the M—K smallest eigenvalues 
of . The MUSIC method thus consists in estimating 

the DoA 9i,... ,9 k as the K most significant minima of the 
estimated pseudo-spectrum 

p^)(0)=a(0)*ll^a(0), 


where the superscript refers to “traditional estimate”. 

The SCM is known to be an accurate estimator of the true 
covariance matrix when the number of available samples A 
is much larger than the observation dimension M. Indeed, in 
the asymptotic regime where M is constant and A converges 
to infinity, under some technical conditions, the law of large 
numbers ensures that 


YnY% 

A 



SjyS^ 

A 



—)• 0 , 


(3) 


almost surely (a.s.) as A —> oo, where ||.|| stands for the 
spectral norm. This implies that 


Hat — n 


0 

N—^oo 


(4) 


i.e. the sample projection matrix 11 at is a consistent estimator 
of n. Moreover, (4) directly implies the uniform consistency 
of the traditional pseudo-spectrum estimate 


sup 

OG [— 7 r,' 7 r] 


'nNi0)-vi0) 


0 . 

N—¥CX) 


(5) 


The K MUSIC DoA estimates, defined formally, for k = 
by 


^fc.AT = argmin?7^^(6»), 


where Xk is a compact interval containing 9k and such that 
Xfc n 2/ = 0 for A: 7 ^ are therefore consistent, i.e. 


6(0 


N—¥00 


->■ 9h. 


Several accurate approximations of the MSB on the MUSIC 
DoA estimates have been obtained (see e.g. [18] and the 
references therein). 

In the situation where M, A are of the same order of 
magnitude, (3), and therefore (4) as well as (5), are no longer 
true. To analyze this situation, [13] proposed to consider the 
non standard asymptotic regime in which 

M 

M, A —>■ oo such that — —)■ c > 0. (6) 

In [20], an estimator fiN{S) of the pseudo-spectrum r]{9) 
was derived. Under an extra assumption, called the separation 
condition, it was proved to be consistent in the new asymptotic 
regime (6), that is 


VNiO) - iiiff) 0, 

almost surely, when ^ M, A —> oo such that ^ > c > 0. In 

the case where the number of sources K remains fixed when 


^ An estimator 9^ of a. (possibly depending on N, M) DoA On is defined 


as A’-consistent if almost surely, N 


(^9n — i 


0 as M, N oo. 


^Note that in that case ri{9) depends on M (and thus implicitely on N). In 
the next sections, a subscript N will be added to make clear this dependence. 
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M and N increase, the separation condition was shown to 
hold if the eigenvalues of A* are above the threshold 

a^y/c [20, Section III-C]. Note that a similar estimator was 
previously derived in [13] in the unconditional source signal 
case. A stronger result of uniform convergence over 6 was 
proved in [6], that is 

sup |?7 a,(6») - ?7(6»)| ^ 0, 

9 ^ [—7r,7r] 

almost surely. When K and the DoA {dk)k=i,...,K remain 
fixed, the G-MUSIC DoA estimates, defined for k = 1,... ,K 
by 0k,N = argminggj;^ fiNifi), were also shown to be N- 
consistent, that is 

N (j)k,N — Ok^ —> 0 

almost surely, when M, A —>■ oo such that ^ > c > 0. More 

recently, [7] also proposed a second-order analysis of the G- 
MUSIC DoA estimates (in the conditional case), in terms of a 
Central Limit Theorem (CLT) in the latter asymptotic regime. 

The work in [7] assumes that the source signals are spatially 
uncorrelated asymptotically, that is converges to 

a positive diagonal matrix as A —> oo, and both [6] and 
[7] that the source DoA 9i,... ,9 k are fixed with respect to 
M, A. This latter assumption is suitable for practical scenarios 
in which the source DoA are widely spaced. However, for 
scenarios in which the source DoA are closely spaced, e.g. 
with an angular separation of the order O the analysis 

of G-MUSIC provided in [6] and [7] are not relevant anymore. 

In this paper, we address a theoretical comparison between 
the performance of MUSIC and G-MUSIC in the two follow¬ 
ing scenarios. 

In a first scenario, in which the number of sources K and 
the corresponding DoA 9i,... ,9 k are considered fixed with 
respect to M, A (referred to as “widely spaced DoA”) and 
where it is known that G-MUSIC is A-consistent, we prove 
that, while the traditional MUSIC pseudo-spectrum estimate 
(^) inconsistent, the MUSIC algorithm is A-consistent 
and that the two methods exhibit the same asymptotic Gaus¬ 
sian distributions. We remark that the analysis provided for 
this scenario allows spatial correlation between the different 
source signals. 

In a second scenario, we consider K = 2 spatially un¬ 
correlated source signals with DoA 9i and 02 depending on 
M, A such that their angular separation 9i — 92 = O 
when M, A converge to infinity at the rate. We show in this 
context that the G-MUSIC DoA estimates remain A-consistent 
while MUSIC looses its A-consistency. We also provide in this 
scenario the asymptotic distribution for the G-MUSIC DoA 
estimates. 

To obtain the asymptotic distribution of G-MUSIC under 
the two previous scenarios, we rely on a Central Limit The¬ 
orem (CLT) which extends the results obtained in [7] using 
a different approach, and which allows situations involving 
spatial correlations between sources and closely spaced DoA. 
A CLT for the traditional MUSIC DoA estimates is also given 
in the first scenario using the same technique. The proofs 
of these results need the use of large random matrix theory 
technics, and appear to be quite long and technical. Therefore, 


we choose to not include them in the present paper. However, 
the derivations are available on-line at [22]. 

B. Organization and notations 

Organization of the paper: In section II, we review some 
basic random matrix theory results, concerning the asymptotic 
behaviour of the eigenvalues of the SCM in the case where 
the number of sources K remains fixed when M and A 
increase. We then make use of these results to introduce the 
estimator of any bilinear form of the noise subspace projector 
n, derived in [20]. We also give a Central Limit Theorem 
(CLT) for this estimator, which will be used in the subsequent 
sections to derive the asymptotic distribution of the G-MUSIC 
DoA estimates. In section III, we prove that MUSIC and 
G-MUSIC are both A-consistent in the scenario where the 
source DoA are widely spaced. However, in a closely spaced 
DoA scenario, we prove that MUSIC is not A-consistent, 
while G-MUSIC is still A-consistent. Finally, we provide 
in section IV an analysis of G-MUSIC and MUSIC DoA 
estimates in terms of Asymptotic Gaussianity. In particular, it 
is shown that MUSIC and G-MUSIC exhibit exactly the same 
asymptotic MSE in the widely spaced DoA scenario and for 
asymptotically uncorrelated source signals. Some numerical 
experiments are provided which confirm the accuracy of the 
predicted performance of both methods. 

Notations: For a complex matrix A, we denote by A^, A* 
its transpose and its conjugate transpose, and by tr (A) and 
||A|| its trace and spectral norm. The identity matrix will be I 
and e„ will refer to a vector having all its components equal to 
0 except the n-th equals to 1. The notation spanjxi,..., x„} 
will refer to the vector space generated by xi,... ,x„. The 
real normal distribution with mean m and variance is 
denoted A/R(a, and the multivariate normal distribution in 
R*, with mean m and covariance E is denoted in the same way 
A/Rfc(m, r). A complex random variable Z = X + iY follows 
the distribution A/c(a + i/3,cr^) if X and Y are independent 
with respective distributions Afu^a, and A/k(/ 3, ^). The 
expectation and variance of a complex random variable Z will 
be denoted E[Z] and V[Z]. For a sequence of random variables 
(A„)„giM and a random variable X, we write 

A„ X and A„ A 

n—foo n—¥oo 

when A„ converges respectively with probability one and in 
distribution to X. Finally, A„ = op(l) will stand for the 
convergence of A„ to 0 in probability, and A„ = Op{\) will 
stand for tightness (boundedness in probability). 

IT Asymptotic behaviour of the sample 

EIGENVALUES AND EIGENVECTORS 

In this section, we present some basic results from random 
matrix theory describing the behaviour of the eigenvalues 
of the SCM in the asymptotic regime where M, A 

converge to infinity such that ^ > c > 0. These results 

are required to properly introduce the improved subspace 
estimator of [20]. To that end, we will work with the following 
more general model, referred to as “Information plus Noise” 
in the literature. 
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We consider M, N, K G N* such that K < M and M = 
M{N), is a function of N satisfying ^ 

as TV 00 . Thus, in the remainder, the notation N —>■ oo will 
refer to the double asymptotic regime M, N —>■ oo, M/N -G 
c > 0. We also assume that K is hxed with respect to N (for 
the general case where K may possibly go to infinity with 
N, see [20]). We consider the sequence of random matrices 
of size M X N where ^ 

T,N=BN+'W]y, (8) 

with 

• B^v a rank K deterministic matrix satisfying 
sup^ IIBatII < oo, 

• Wjv having i.i.d. Me (^0, entries . 

We denote by Ai jv > ■ • • > ^k,n the non zero eigenval¬ 
ues of and by Ui^n, ... ,uk,n the respective unit 

norm eigenvectors. {uk^N)k=K+i,...,M are unit norm mutually 
orthogonal vectors of the kernel of BjyB^. Equivalently, 
Ai,Ar > ... > Am, AT are the eigenvalues of the matrix 
and Ui, 7 v,. •., um.jv the respective unit norm eigenvectors. 


A. The asymptotic spectral distribution of the SCM 

Let /ijv be the empirical spectral measure of the matrix 
defined as the random probability measure 


fltN 



k=l 


with 5x the Dirac measure at point x. The distribution /tjv can 
be alternatively characterized through its Stieltjes transform 
dehned as 

^ ( \ f c]/ 4A^(A) 1 , Tt~t 

mN[z) = ^ = ^tr (SatSjv - zl) 

where — zl)~^ is the resolvent of the matrix 

It is well-known from [12] that for all z S C\IR, 

niNiz) > m(z), (9) 

N—¥00 


where 


m{z) 


f dM(A) 
K A — z 


is the Stieltjes of a deterministic probability measure called the 
Marchenko-Pastur distribution, whose support coincides with 
the compact interval [cr^(l — i/c)^,(t^(1 + s/c)'^], and which 
is dehned by 


d/i(x) = 


1--) do 


^J[x — X ) (a;+ — x) 


2a'^c'KX 


Iw- 


1 (tcjdcc. 


^The condition vW (cjv — c) —^ 0 is purely technical and is in fact only 
needed for the validity of Theorems 3, 8 and 7 below. 

'^Of course, we retrieve the usual array processing model (1) by setting 
Sjv = AT-i/^Yjv, Bjv = Y-i/^aSat and Wjv = Ar-V2Vjv. 


with x~ = tT^(l — a/c)^ and = cr^(l + a/c)^. 

Moreover, m{z) satishes the following fundamental equa¬ 
tion 

= • -7 7 "i —2-rvTd— 27i -V- 

—z (1 -I- a^cm(z)) + 0-2(1 — c) 

An equivalent statement of (9) is given with the following 
convergence in distribution 


fkN 


V 

-S- /i 

AT-too 


which holds almost surely, that is, the empirical eigenvalue 
distribution of has the same asymptotic behaviour as 

the Marchenko-Pastur distribution. Practically, the eigenvalue 
histogram of matches the density of the Marchenko- 

Pastur distribution, for M, N large enough, as shown in Figure 
1, where we have chosen M = 1000, N = 2000, cr^ = 1 and 
K = 2 with Ai^a = 5 and A 2 ,Ar = 10. 


Limiting spectrai distribution and histogram of the sampie eigenvaiues 



Fig. 1. Marchenko-Pastur distribution and eigenvalue histogram of 

Remark 1. The Marchenko-Pastur distribution was originally 
obtained as the limit distribution of the empirical eigenvalue 
distribution of the noise part WjyW^. Nevertheless, the 
assumption that the rank K of the deterministic perturbation 
BAT is independent of N implies that the Marchenko-Pastur 
limit still holds for EyrEff. This fact is well known, and can 
be easily seen by expressing mpj{z) in terms of the Stieltjes 
transform of the spectral distribution o/WjvW](f. Finite rank 
perturbations ofWy are often referred to as “spiked models” 
in the random matrix literature [1 ]. 


B. Asymptotic behaviour of the sample eigenvalues 

As also noticed in Figure 1, the non zero eigenvalues Ai jv 
and X 2 ,n of BjvBJ^ generate two outliers Xi^n, X 2 ,n in the 
spectrum of E^Ey, in the sense that Xi^n, X 2 ,n are outside 
the support of the Marchenko-Pastur distributions, 

while all the remaining eigenvalues X^^n, ■ ■ ■ , Xm,n concen¬ 
trate around [x~,x'^]. 

In fact, under an additional condition on the non zero eigen¬ 
values Ai^at, ..., Xk,n, it is possible to characterize the be¬ 
haviour of the K largest sample eigenvalues Ai^Af, ■ • •, Xk,n- 
The following assumption, usually referred to as subspace 
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separation condition, ensures that the K non zero eigenvalues 
of are sufficiently separated from the M — K zero 

eigenvalues. 

Assumption 1. For k = Xk,N Xk as N ^ oo, 

where 

Ai > ... > Ak > 

We note that forthcoming results remain valid if some 
{Xk)k=i,...,K coincide. We assume that Xk 7 ^ A; for fc 7 ^ I 
in order to simplify the presentation. Under the previous 
assumption, an accurate description of the behaviour of the 
eigenvalues of can be obtained. 

Theorem 1. Under Assumption 1, for k = 1,... ,K, 

\ as. , ^ (Afe +Cr2)(Afc +ct2c) 

Xk,N -^ 0(Afcj = -r-. 

N—¥00 A/- 

with (j){Xk) > x^. Moreover, for all e > 0, 

Xk+i,n , ■ ■ ■, Xm,n & {x — e, x~^ + e) , 

almost surely for N large enough. 

Theorem 1 is a consequence of the general results proved 
in [ 1 ] (see also [ 11 ] for a different, but less general, proof). 
Rephrased in another way, under the separation condition, the 
K largest eigenvalues of escape from the support of 

the Marchenko-Pastur distribution while the smallest M — K 
eigenvalues are concentrated in a neighborhood of [x~ ,x^]. 


Theorem 2. Under Assumption 1, for all deterministic se¬ 
quences of unit norm vectors (di^Tv), (d 2 ,Ar), we have for 
k = l,...,K 

*^l.N^k,N'^k,N*^2,N = 

h {<j){Xk)) dl^^Uk,Nul j^d 2 ^N + 0 ( 1 ) a.s., 


h{z) = 


w{z)'^ — cr^c 
w{z) {w{z) + (T^c) 


Since the function f is the inverse of the function w, we 
obtain an explicit expression for h{(f){Xk)) ■ 


hifiXk)) = 


Xk (Xk + cr^c) ■ 


Define the following bilinear form of the noise subspace 
orthogonal projection matrix: 

VN = d*_^nArd 2 ,Ar, ( 12 ) 

as well as its traditional estimate 

77 ^^ = dlj.,flNd2,N- ( 13 ) 

Then Theorem 2 shows in particular that 


Vn = 


'^-'^hifiXkfuk^Nul,! 


N '^2,N 


Remark 2. Theorem 1 in conjunction with Assumption 1 have 
a nice interpretation (see e.g. [15] and [2] in the conditional 
case). Indeed, we notice that the separation condition can 
be interpreted as a detectability threshold on the SNR con¬ 
dition, if we define the SNR to be the ratio Therefore, 
Theorem 1 ensures that the K “signal sample eigenvalues” 
Ai.at, ..., Xk,n will be detectable in the sense that they will 
split from the M — K “noise sample eigenvalues” as TV —)■ oo, 
as long as the SNR is above \fc. 

C. Estimation of the signal subspace 

In this section, we introduce a consistent estimator of any 
bilinear form of the noise subspace orthogonal projection 
matrix, which was derived in [7] (see also [20]). Let us 
introduce the function 

w{z) = 0 (l + a^cm{z))'^ — a‘^{l — c) (l + a‘^cm(z)) . 

From the fixed point equation (10), straightforward algebra 
leads to the new equation 

(j){w{z))=z, ( 11 ) 

and one can see easily that the function A i—(/)(A) 
is a one to one correspondence from + 00 ) onto 

+ -v/c)^, + 00 ) with inverse function x 1 —>■ w(x) defined 
on the interval + -v/cj^j+oo) (see [22]). 

The following fundamental result was proved in [1] (see 
also [7]). 


a.s., which implies that the traditional subspace estimate is not 
consistent. 

Moreover, Theorem 1 in conjunction with Theorem 2 di¬ 
rectly provides a consistent estimator of (12). Indeed, under 
Assumption 1, 

m - m 0 , (15) 

N —>-oo 

where 

/ ^ 1 _ \ 

Vn = dj JV I I “ X/ — 7~- - I d2,Ar. (16) 

y k=i h IXk.Nj J 

Remark 3. It should be noticed that the estimator given 
in (16) provides in particular a consistent estimator of any 
{i,j)—th entry ofTlN, by choosing di^jv = and d 2 ,Ar = 
However, (15) does not imply that we have a norm-consistent 
estimator o/TEjv, in the sense that 



does not necessarily converge to 0 as N ^ 00 . 

A result concerning the asymptotic Gaussianity of the 
estimator pjv can be also derived. Let 'dk,t be defined under 
Assumption 1 by 

a^c (AfcAf + {Xk + Xi)a'^ + cr^) (A^A^ + 

4 (A^ - fj^c) (Xj - a'^c) (XkXe - a^c) 
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Xfc/ ~ AfcAf (AfeAf + a^{\k + A^) + ((1 + c)(AfcAf + a^c) + 2a‘^c{Xk + A^)) 

— c (AfcA^ — (T^c) (XkXi + <T^{Xk + A^) + CT^c) . 


for 1 < k, i < K, and by 




0-2 (Afe + 0-2) 

4(A2-a4c) 


for k<K,£>K + l, with dk^e = set '0i,£ = 0 for 

k,i > K + 1. Define finally 


M 


In — 'y ' £^k,e |ufc,Ar (di,Afd2 jv + d2^Ard*^^) ur^jvj 

k,t=l 

We then have the following result. 


(17) 


Theorem 3. Under Assumption 1, //’liminfTv 7Ar > 0, then 

(18) 

VW N^OO 

The proof of Theorem 3, which requires the use of technical 
tools from random matrix theory, is not included in the paper 
and is available in [22]. 

To conclude this section, we also provide a result on the 
asymptotic Gaussianity of the classical subspace estimator 
(13), which will prove to be useful to study the behaviour 
of MUSIC in the next section. In the same way as (17), we 
define 

(t) _ ^_A^r_ 

4 XkXi{Xk +cr‘^cY{Xt +a‘^cY{XkXi-a‘^c) 

for 1 < < K, where x^*^\k,t) is given at the top of the 

page (note that x^k \ > 0)> by 

n(t) ^ 0-^ (Afc + a^) {Xl - a^c) 

4A2 (Afc + a^cf 

for k<K^i>K + l, with and set = 0 for 

k^^ > K -\-1. Define finally 

M 

H I^In (di.Afd; + d2,Ndlj^) ■ 

k,e=i 

(19) 


Then the following result holds. 

Theorem 4. Under Assumption 1, if lim inf tv 7^^ > 0, then 

_Re 


Viv- 


V 

N—¥00 


> Nu (0,1), (20) 


where 


(i) J* T \ '' h:,2\ ■’ * j 

Vn — \ ^-v , \^k,N^k,N ^2,N- 


K 


\ 2 2 

N ~ ^ 


^k,N 

^ Afc,AT (Afc,AT + o'^Cn) 


The proof of Theorem 4 is given in [22]. 


D. Connections with others improved subspace estimators 

Estimator (16) is valid under the hypothesis that the number 
of sources K remains fixed when N —)■ +oo. We recall that, 
under the hypothesis that the source signals are deterministic, 
or equivalently in the conditional case, [20] proposed a con¬ 
sistent estimator of pAf, say fiN,c, valid whatever K is, and 
that it was proved in [20] that 


Vn,c -fiN-tO a.s. 


( 21 ) 


It is even established in [22, Remark 3.] that 


flN,c — VN = Op 



( 22 ) 


Therefore, if K is fixed, the original subspace estimator 
derived in [20] appears to be equivalent to the estimator (16). 

If the K dimensional source signal (s„) is assumed to be 
i.i.d. complex Gaussian, or equivalently in the unconditional 
case, [13] proposed another consistent estimator, denoted f]N,u, 
also valid whatever K is in the unconditional case. When K is 
fixed, and when (s„) is deterministic, that is, in the conditional 
case, it is shown in the Appendix A that 


Vn,u 



(23) 


Therefore, if K is fixed, the subspace estimator of [13], in 
principle valid in the unconditional case, behaves as tin, 
or equivalently as the estimator pAf.c derived in [20] in the 
conditional case. In conclusion, if K is fixed, in the conditional 
case, the estimators fiN,u, flN,c and pat are all equivalent. In 
section IV-B, simulations are provided to illustrate that ryAr and 
'f]N,u{()) present the same performance, in the context of DoA 
estimation. 


III. Analysis of the consistency of G-MUSIC and 
MUSIC 

From now on, we use the results of section II for Sa^ = 
N-^/^Yn, Btv = W-l/2A(0)SAr, Wat = N-^/^Yn, 
dl.Af = d 2 .Ar = Si{d) and assume that Assumption 1 holds. 
Based on the subspace estimator (16), [7] proposed the im¬ 
proved pseudo-spectrum estimator 

^ 1 

'nN{0) = i-'^ —TV—Y I (24) 

fc=i h (Afc ,at 1 

Remark 4. The pseudo-spectrum estimator (24) can be 
viewed as a weighted version of the traditional pseudo¬ 
spectrum estimator 

K 

7a ((*) = 1 -X] |a(6»)*Ufc,A|^ 
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Therefore, there is no additional computational cost by us¬ 
ing this improved pseudo-spectrum estimator (which gives 
the G-MUSIC method described below), since it also relies 
on an eigenvalues/eigenvectors decomposition of the SCM 
Moreover, in the traditional asymptotic regime 
where ^ ^ 0, by setting c = 0, we remark that h{z) = 1 
and thus the improved pseudo-spectrum estimator reduces to 
the traditional one. 

From (15), we have directly that fiN{S) — Vn{()) —t 0 a.s. 
as -/V —> oo, for all 9. In Hachem et al. [ 6 ], this convergence 
was also proved to be uniform, that is 

sup |pjv( 6 *) - ? 7 jv( 6 i)| > 0, (25) 

ee[-7r,7i-] 

The resulting DoA estimation method, termed as G-MUSIC, 
consists in estimating 6i,... ,9 k as the K most significant 
minima of 9 i—)■ fjN{9). 

Concerning the traditional pseudo-spectrum estimator 
Theorem 2 directly implies that for all 9, 

Af—>-oo 

where 

Vn\9) = 1 - X! X m ^2 \ |a( 6 >)*Ufc,jv|^ . (26) 

^ Afc (Afc -I- a^c) 

A. N-consistency for widely spaced DoA 

In this section, we consider a widely spaced DoA scenario. 
In practice, such a situation occurs e.g. when the DoA have 
an angular separation much larger than a beam width 
Mathematically speaking, we will therefore consider that the 
DoA 9i,...,9k are fixed with respect to N. In that case, 
A* A —> I and the separation condition (Assumption 1) 
holds if and only if the eigenvalues of converge to 

Al > ... > Xk > cr'^sfc. To summarize, we make the 
following assumption. 

Assumption 2. K, 9i,..., 9 k <^re independent of N, and the 
eigenvalues of converge to 

Xi > ... > Xk > cP‘\fc. 

Note that Assumption 2 allows in particular spatial corre¬ 
lation between sources, since may converge to a 

positive definite matrix, which is not necessarily constrained 
to be diagonal. 

To study the consistency of G-MUSIC and MUSIC, we need 
to define “properly” the corresponding estimators, to avoid 
identifiability issues. As it is usually done in the theory of 
M-estimation, we consider Xi,... ,Xk C [—tt, tt] K compact 
disjoint intervals such that 9k € Int (Tk) (Int denotes the 
interior of a set), and formally define the G-MUSIC and 
MUSIC DoA estimators as ^ 

9k,N = argminr/K (9) and 9j!l^ = argminf^ (9). (27) 

^Note that the G-MUSIC cost function can be negative due to the presence 
of the weighting factor h(Xk jv)~^ in (24). 


We have the following result, whose proof is deferred to 
Appendix B. 

Theorem 5. Under Assumption 2, for k 
dk,N = ° = 

with probability one. 

The results of Theorem 5 show that both the G-MUSIC 
and MUSIC methods have the same first order behaviour, i.e. 
are A-consistent, when the angles 9i,... ,9 k are fixed with 
respect to N. In section IV, it will be further shown that the 
MUSIC method also has the same asymptotic MSE as the 
G-MUSIC method as N ^ oo. 


= 0 fc+o(^), 


B. N-consistency for closely spaced DoA 

In this section, we study the consistency of G-MUSIC and 
MUSIC in a closely spaced DoA scenario, where we let the 
DoA 01 jv, ..., 9k,n depends on N and converge to the same 
value at rate O To simplify the presentation, we only 
consider K = 2 sources with DoA 0i jv and 02 ,iv = 0i.n + -^, 
where a > 0 , and assume asymptotic uncorrelated sources 
with equal powers, that is A^^SatS^ —> I. In this case, 
it is easily seen that the two non null signal eigenvalues of 

ASjvSUA'^ 

—— converge to 


Ai(ci!) — 1 -f 



and 


A 2 (ct) — 1 — 



where sinc(x) = sin(x)/a; if a; 7 ^ 0 and sinc(O) = 1. 
Therefore, the subspace separation condition (Assumption 1) 
holds if and only if A 2 (a) > cP'\fc. To summarize, we 
consider the following assumption. 


Assumption 3. We assume that K = 2, 


SnS*k 

A 


N—¥(yo 


^ I, 


and that the DoA 0i,Ar, 02 ,A depend on A in such a way that 
92,N = Qi,N + 

where a > 0 satisfies 

sinc(f) 

Since the DoA are not fixed with respect to A, we define, 
in the same way as (27), the G-MUSIC and MUSIC DoA 
estimates as 


< 1 — a^^/c. 


9k,N 


argminpAr(0) and 0^*^^^ = argminp^^(0) (28) 

9GTk,N ’ 9GTk,N 


where tv is defined as the compact interval 


Xfe,A = 


()k,N — 


a — € 
2N ' 


Ok. 


a — e 


N ' 


2A 


with 0 < e < a. The A-consistency results for G-MUSIC 
and MUSIC in the closely spaced DoA scenario can be 
summarized as follows. 
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Pimction kW(I3) (for q =1.5708) 



(a) a = 0.25^10 

Fimctioii kM(/ 3) (for a =12.5664) 



(b) a = 271 jc 


Fig. 2. Function [3 ^ (/5) for cr = 1, c = 0.5 and different values of a 

(the dashed lines represent the location of 0 and a) 


Theorem 6. Under Assumption 3, for k € {1,2}, 

0k,N = 0k,N + o ) (29) 

with probability one. Moreover, if 0 and a are not local 
maxima of the function j3 i—)■ (/3) defined by 


C. Remarks on the spatial periodogram 

Regarding the previous results on the consistency of the 
MUSIC estimator for widely spaced and closely spaced sce¬ 
narios, it is natural to ask how traditional “low resolution” 
techniques for DoA estimation behave. 

Considering the classical spatial periodogram cost function, 
that is 

we can prove, such as in [6, Sec. 3.3], that 


sup 

OG [—77,Tt] 




ip) I 


N—foo 


-4 0, 


where ri^^\o) = 3.(0)* A* +<7^1^ a(^)- Moreover, 

following the steps of the proof of Theorem 5 for the MUSIC 
estimates, we end up as well with 

=6k+o ^ —^ , 


with probability one, where 0^]^ = argmax^gj;^ r)(^^(0). 
Therefore, the spatial periodogram also provides consistent 
estimate in the widely-spaced DoA scenario, without any 
requirements on the sources power (i.e. without need of 
the separation condition Afc > k = 1,..., K). This 

confirms the well-known fact that the use of subspace methods, 
especially MUSIC, is not necessarily a relevant choice for 
estimating the DoA of widely spaced sources. Nevertheless, 
in certain scenarios involving correlated source signals and 
widely spaced DoA and for which the spatial periodogram may 
exhibit a non negligible bias at high SNR, the use of subspace 
methods may still be interesting (see numerical illustrations in 
Section IV-B). 

However, in the scenario of closely spaced DoA, one can 
also prove, following the steps of Theorem 6, that the spatial 
periodogram suffers the same drawback as MUSIC, and is not 
capable of consistently separating two DoA with an angular 
spacing of the order O (^). Simulations are provided in the 
next section to illustrate these facts. 


At«(/3) = 

(Ai(a)^ — cr^c) (sinc(/3c/2) -f sinc((/3 — a)c/2))^ 

2Ai(a)^ (^i(c«) + o’^c) 

(A2(a)2-CT‘‘c)(smc(/3c/2)-sinc((/3-a)c/2))^ 
2A2(a)2(A2(a) + a2c) 

then N — 0k,does not converge to 0. 

The proof of Theorem 6 is deferred to Appendix C. 

Theorem 6 shows that the G-MUSIC method remains N- 
consistent when two sources have DoA with a spacing of the 
order O (M“^) while MUSIC may not be able to consistently 
separate the two DoA if the spacing parameter a is not a local 
maximum of the function defined in (30) (numerical examples 
are given in Figure 2). This confirms the superiority of G- 
MUSIC over MUSIC in closely spaced DoA situations and 
low sample size situations. 


IV. Asymptotic Gaussianity of G-MUSIC and 
MUSIC 

We now apply the results of Theorems 3 and 4 to obtain a 
Central Limit Theorem for the G-MUSIC and MUSIC DoA 
estimates. The results for G-MUSIC will be valid for both the 
widely spaced and closely spaced DoA scenarios introduced 
in the previous section, while the CUT for MUSIC will be 
only valid for the widely spaced DoA scenario, since it is not 
A-consistent for the other situation. 

A. CUT for G-MUSIC and MUSIC 

The following Theorem, whose proof is given in Appendix 
D, provides the asymptotic Gaussianity of the G-MUSIC DoA 
estimates, under Assumption 2 or Assumption 3. We denote 
by sl{0) and a" (6*) respectively the first and second order 
derivatives w.r.t. 0 of the function 0 ^ 3{0). 
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Theorem 7. Under Assumption 2 or Assumption 3, 

(Ok,N — 0k,jv) —>■ ■Mr(0, 1). 


JV^/2 


\ 




In 


N —>-oo 


(31) 


for k = 1,..., K, where nm is defined by (17), with di at = 

In particular, by considering the settings of Assumption 2 
and adding the following spatial uncorrelation condition 


N 


N—^oo 


> diag(Ai,...,Aif). 


(32) 


we obtain, using the usual asymptotic orthogonality between 
a(0fc) and Uk',N for k ^ k' (see e.g. [7, Lem. 8 ]), 




n^rdi^ 


N 


— and 77 V 






tv->oo 24 A^ — cr'^c 


N^oo 12 

Thus, we retrieve the results of [7] under this particular 
assumption; 

6 cr^(Afe + cr^)' 


(9k.N-0k) (0 

V / N^oo V 


A^- 


(33) 


Therefore, Theorem 7 extends the results of [7] to more 
general scenarios of correlated sources and not necessarily 
widely distributed sources. 

Concerning the MUSIC method, we obtain the following 
result in the widely spaced DoA scenario. 

Theorem 8. Let be the second order derivative of 

9 I— T]'^ (9) defined in (26). Under Assumption 2, and if 


liminf > 0, 

A/—>-oo 


it holds that 
7V3/2 


\ 


ri‘'}^^^\9ky 


^iN 


(^fc.AT 


V 


N—foo 


>AfR(0,l), (34) 


for k = 1,..., K, where 7 ^^ is defined by (19) by setting 
di,N = N-^a'{9k) and da ,tv = a{9k), 

The proof of Theorem 8 , which is based on the CLT of 
Theorem 4, is similar to the one of Theorem 7 and is therefore 
omitted. 

Theorem 8 , having been derived under Assumption 2, allows 
in particular correlation between source signals. Moreover, by 
assuming asymptotic uncorrelation between sources, i.e. that 
(32) holds, we obtain 


j^29n \9k) 


_. c\Xl-a^c) ^ 

Af-foo 6Xk{Xk + cr^c)’ 


(35) 


and 


(*) 

Tn 


N—foo 


which implies 


c^(Afc + o'^)(Afc - a^c) 
24A|(Afc + cr2c)2 

6 cr^(Afe + 0-2) 


■D 


N—¥oo 


->■ A/r 0 


Xl-a*c 


(36) 


The striking fact about Theorem 8 is that, in the widely spaced 
scenario, the variance of the MUSIC estimates obtained in (36) 
coincides with the variance of the G-MUSIC estimates (33) 
previously derived in [7]. This shows that MUSIC and G- 
MUSIC present exactly the same asymptotic performance for 
widely spaced DoA and uncorrelated sources, which reinforces 
the conclusions given in Section III-A. 

B. Numerical examples 

In this section, we provide numerical simulations illustrating 
the results given in the previous sections. 

To illustrate the similarity between the theoretical MSB 
(formula of Theorem 7) and its approximation for uncorrelated 
source signal and widespace DoA (specihc formula of (33)), 
we plot these two formulas in Figure 3(a) and Figure 3(b), 
together with the empirical MSB of the G-MUSIC estimate 
01 ,TV and the Cramer-Rao bound (CRB). The parameters are 
K = 2, M = 40, N = 80, SNR = -101og(cr2). In 
Figure 3(a), we consider the context of widespace DoA with 
uncorrelated source signal, by choosing a signal matrix Stv 
with standard i.i.d A/c(0,1) entries, and setting 9i = 0, 
02 = 5 X The separation condition Xk > cr'^^/c occurs 

around SNR = 0 dB. In this situation, we notice that the 
two MSB formulas match, as discussed in Section IV-A. In 



(a) Uncorrelated source signals 



(b) Correlated source signals 


Fig. 3. Empirical MSE of for widely spaced DoA versus SNR (dB) 
Figure 3(b), we consider the context of widespace DoA with 
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significant correlation between source signals, by choosing 
a matrix Sjv = with R = [1,0.4; 0.4,1] and 

Xjv having standard i.i.d A/c(0,l) entries. The separation 
condition occurs around SNR = 2 dB. We notice that the 
MSE formula of Theorem 7 is relatively accurate while a 
discrepancy may occur for the formula (33), since the spatial 
uncorrelation is not fulhlled in that case. 

In Figure 4, we consider the context of widespace DoA 
and uncorrelated source signals, and compare the performance 
of G-MUSIC, MUSIC and DoA estimation with spatial pe- 
riodogram, in terms of MSE on the hrst DoA estimate. The 
empirical MSE of 6i^m together with its theoretical MSE given 
in Theorem 7, as well as the empirical MSE of and 
9^^]^ are plotted. The parameters are M = 40, N = 80, and 
01 = 0, 02 = 5 X The signal matrix Sjv has standard i.i.d 
A/c(0,1) entries, and the separation condition occurs around 
SNR = 0 dB. We notice in Figure 4 that the performance 



Fig. 4. Empirical MSE of 6i,jv, widely spaced DoA and 

uncon'elated source signals, versus SnR (dB) 

of G-MUSIC, MUSIC as well as the DoA estimate from the 
spatial periodogram coincide, since the source DoA are widely 
spaced (hve times the beamwidth |j). We also notice that the 
threshold effect of the spatial periodogram is less signihcant, 
since it is not constrained by the subspace separation condition 
(see Section III-C). 

In Figure 5, we consider the same simulation as for Figure 
4, except that we add signihcant correlation between sources, 
by taking S^r = R^^^X^v with R = [1,0.4; 0.4,1] and Xjv 
having standard i.i.d A/c(0,l) entries. Again, we notice that 
both G-MUSIC and MUSIC perform well, since the DoA are 
widely spaced. Concerning the spatial periodogram method, 
we notice that a strong bias occurs at high SNR, which 
corresponds to the well-known effect of source correlation on 
spatial beamforming techniques (see [16]). 

To illustrate the asymptotic Gaussianity of the G-MUSIC 
and MUSIC estimates predicted in Theorems 7 and 8, we plot 
in Figure 6 the histograms of 02 ,at and 02 *]y (5000 draws), 
with the parameters used in Figure 5 (widely spaced DoA and 
correlated source signals, SNR=6 dB). 

Figure 7 illustrates the closely spaced DoA scenario, and 
the parameters are the same as in Figure 4, except for the 
DoA hxed to 0i = 0, 02 = 0.25 x The separation 



Fig. 5. Empirical MSE of 0i,jv, widely spaced DoA and 

correlated source signals, versus SNR (dB) 




0.72 0.74 0.76 0.78 0.8 0.82 0.84 


(b) MUSIC 


Fig. 6. Histograms of 62 ,N ™d compared to their asymptotic Gaussian 
distribution 


condition is fulhlled for all SNR. One can observe that a 
strong difference occurs between the performances of the 
G-MUSIC and MUSIC methods, e.g. a difference of 4 dB 
between the threshold points of G-MUSIC and MUSIC can be 
measured, which illustrates the result of Theorem 6. Moreover, 
we notice the poor performance of the spatial periodogram 
DoA estimate, which suffers from the well-known resolution 
loss, since the DoA spacing is lower than a beamwidth. 

Similarly, in Figure 8, we keep the same parameters as for 




























II 



Fig. 7. Empirical MSE of 6i,jv, ^i^jv closely spaced DoA 

versus SNR (dB) 



Fig. 8. Empirical MSE of 6i,jv, ^i^jv closely spaced DoA 

(undersampled), versus SNR (dB) 


Figure 7 except that M = 40 and N = 20. Thus, we consider 
an “undersampled” scenario in which N > M. In that case, 
G-MUSIC still outperforms the MUSIC estimates, with about 
6 dB between the threshold points. 

In Figure 9, we provide the empirical MSE of MUSIC 
together with the theoretical MSE given in Theorem 8. The 
parameters are M = 40, iV = 80, 6>i — 0, 02 = 5 x 
and correlated source signals with correlation matrix R = 
[1,0.4; 0.4,1] and the separation condition occurs near 2 dB. 
One can observe the accuracy of the theoretical MSE predicted 
in Theorem 8. 

Einally, we provide in Eigures 10 and 11a comparison be¬ 
tween the conditional and unconditional G-MUSIC estimates, 
using respectively the same scenarios as for Eigure 4 and 7. 
The unconditional G-MUSIC estimator is computed with the 
formula of [13]. We observe that the two estimators exhibit 
the same empirical MSE as soon as the separation condition 
is fulfilled (around SNR = 2 dB for Eigure 10 and verified for 
all SNR in Eigure 11), which illustrates the remarks in Section 
II-D on the connections between both estimators. 



Eig. 9. Empirical MSE of for widely spaced DoA and conelated 

sources, versus SNR (dB) 



Fig. 10. Empirical MSE of Oi^n’ (conditional and unconditional G-MUSIC), 
for widely spaced DoA and uncorrelated source, versus SNR (dB) 



V. Conclusion 

In this paper, we have adressed a statistical comparison of 
the performance of the G-MUSIC and MUSIC method for 


Fig. 11. Empirical MSE of (conditional and unconditional G-MUSIC), 
for closely spaced DoA and uncorrelated sources, versus SNR (dB) 
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DoA estimation, in an asymptotic regime where the number 
of sensors M and the number of samples N both converge to 
infinity at the same rate. Two scenarios were considered. In 
a first scenario where the source DoA are widely spaced (i.e. 
fixed with respect to M,N), we have proved that both MUSIC 
and G-MUSIC exhibit the same asymptotic performance in 
terms of consistency and asymptotic Gaussianity, In a second 
scenario where the source DoA are closely spaced (i.e. with 
an angular separation of the order of a beamwidth 
we have proved that G-MUSIC is still A^-consistent, while 
MUSIC is no more able to separate the DoA. The asymp¬ 
totic Gaussianity of G-MUSIC and the identification of its 
asymptotic MSB provided in this paper hold under general 
conditions, including correlation between sources, and extend 
previous existing results which were only valid for asymptot¬ 
ically uncorrelated source signals. 


Appendix A 

Comparison between the unconditional subspace 
ESTIMATOR OE [13] WITH THE ESTIMATOR (16). 


In this section, we establish (23) when the source signals 
are deterministic signals satisfying Assumption 1. For this, we 
first recall that the unconditional estimator fjM,u proposed in 
(16) can be written as 


f]N,u = ;r— / dl,A (SatS 


2z7r 


idn 


N 




■2,AT 


gN{z)dz 


(37) 


where gN^z) is defined by 

- {I-CN) + cz^m^{z) 

9n\^) /-. \ ^ ^ ’ 

(1 - Cn) - CNZmN\z) 

and where &R. is a contour enclosing the interval — 

— e, (1 + -v/c)^ + e], e being chosen in such a way that 
CT^(1 + -v/c)^ -f e < Xk, and where we recall that rh]s[{z) = 
;^tr — zl) ^ (ifij^{z) represents the derivative of 

rhN{z) w.r.t. z). Using condition (7), it is easily seen that 
niNiz) = m{z)+op (^^),thatTO^(z) = m {z)+op 
and using an additional argument such as in [22, Sec. 4.1], one 
can show 


VN,c = 

^ dl^ - zl)-i d 2 .Ar g{z)dz + op , 

where 

, , (1 — c) -I- cz^m (z) 

giz) = -z, -T-ta-- 

(1 — c) — czm{z) 


It is established in [22] that 


Vn = 
1 

2z7r 





zl)”^ d 


■2,AT 




1 + a^cm{z) 


dz 



The conclusion follows from the identity 

. ^ w'{z) 

5 ^ = TT—2-TT- 

1 -I- aZcm { z ) 

which can be checked easily. 


Appendix B 
Prooe OF Theorem 5 

The consistency of G-MUSIC is already established in [6], 
and we prove hereafter the consistency of MUSIC. 

From Theorem 2, we have for all 6 e [—tt, tt]. 


with probability one, where 

p^)(0) = l-a(0)*UwDU;fa(0), 

with Uat = [ui^Af, ■ • ■, ua',a] and D = diag(c?i, 

with 


(38) 


) dK) 


j — 

" “ Afc {Xk + a^c) ■ 

It is easily seen that di > d 2 > ■ ■ ■ > dK- Applying verbatim 
the steps of [6, Sec. 3.3], (38) can be strengthened to 


sup 

[—7r,7r] 


dN\d)-Ti%\0) 


N —¥oo 


A 0. 


(39) 


Using the fact that Uat and A share the same image, we have 

where V^v is a A x AT unitary matrix given by Vat = 
(A*A)“^/^A*UAr. Since 9i,...,9k are fixed with respect 
to N, we also have A* A —>■ 1^: as A —>■ oo. It is clear that 
if I ^ k, then it holds that 

sup |a(6<)*a(6>i)| 0 

From this, we obtain immediately that 

sup ||a(0)*Ujv - a(0)*a(0fc)eJV^|| ^ 0 

O^Xk 


and that, for all k 





sup 

VN^d) - (l 

* 

1 

^e^V. 

vDV^efc) 

-^ 0 

N—¥oo 






(40) 

Moreover, it holds 

that 






sup g‘'K\9) 

N—¥oo 

► 1. 

(41) 






We claim that 







2(i) a.s. 

dk- 


(42) 


N—¥00 


To verify this, we first remark that (39) and (40) used at point 


3(0 

^k,N 
-(0/^/g(0 


lead to 


- ( 1 - e*V^DV^efc ) ^ 0 


+ Op 


almost surely. As function of 9, \a{9)*a{9k)\^ has a unique 
global maximum at 9k and that e^VArDV^efc is lower 
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bounded by cIk > 0 so we deduce that (42) holds. Otherwise, 
one could extract from sequence a subsequence 

converging towards a point 0* ^ 0k almost surely. 
This would imply that 

and that 

- (l - |a(i?,)*a(0fc)|2e*V^DV^efc) ^ 0 
However, (39) and (40) used at point 9 = 9k imply that 
77^)(0fc) - (1 - e^VwDV^efe) ^ 0. 


Therefore, for e > 0 small enough, it holds that 

for each N large enough, a contradiction. 

We now improve (42) by showing that 


N 


(nit) 

yk,N 


- dk 


N—¥oo 


-^0, 


(43) 


and for that purpose we follow the approach of [8] (also used 
in [6, Sec. 4]). By definition, we have 


< sup 

[—7r,7r] 


Mfnit) 


it)/nit) 


'St) (ait) 


and from (39) and (40) used at point 9 = 9k, we obtain 
limsupr7^^(0^‘jv) ^ limsupr}^^(0fc) 

N—¥00 ’ N—¥(X) 

= l-liminfe^VjvDV^efc 
N—¥00 

< 1, (44) 


where the last inequality comes from the fact that 
e^VjvDV^efc > (Ik > 0. Assume that the sequence 
N {^^k \ ~ not bounded. Then we can extract a subse¬ 

quence ip{N) (Ok^N) - Okj such that 


‘PiN) 


it) 

k,(p{N) 


— Ok 


N—^oo 


-)• 00. 


This implies that —> 0 and that, by 

(40), —> 1, a contradiction with (44). Since 

N{dt!N — 9k^ is bounded, we can extract a subsequence such 
that 


P{N) 


nit) _ Q 

t’k,^(N) tfk 


N- 


with (3 assumed to lie in [—tt, tt] without loss of generality. If 
/? ^ 0, then (40) gives 

= 1 - eJV^DV^efc sine (/?c/2) + o(l) 

with probability one. Since, in that case, 

limsup?7j^^(0^*^^) > 1 - liminf e^VArDV^efc, 
iv'- • ’ N—^oo 


N—^oo 


this contradicts (44) again. 

Therefore all converging subsequences of the bounded se¬ 
quence N — 9k^ have the same limit, which is 0, and 

thus the whole sequence converges itself to 0, which finally 
shows (43). 


Appendix C 
Proof of Theorem 6 


Recall from (25) that we have supg — Vn{0)\ — 0 

with probability one, with 

,y^(6i) = a(6»)*nAra(6») = 1 - a(6»)*A (A*A)-^ A*a(6i). 


From Assumption 3, we have supg |?7Ar(0) — pAr(0)| —(n 0 
where 

mid) = 1-^a(0)*ATA*a(0), (45) 

1 - sine (f) 

where 

r 1 -e'“‘=/2sinc(f^)' 

Note that 


lim sup 

N—¥(X) 


flN{0l,N) 


< lim sup |r7Ar(6'pAr)| = 0. 

N—¥00 


We next rely on the following lemma. 


(46) 


Lemma 1. If (iPn) is a sequence of [— 7r,7r] such that 
N IV'tv ~ oo, then 


VNifN) 


N—foo 

Moreover, for any compact /C C K, 


1 . 


sup 

/3e/C 


9N ( 6'i.n + ;^ ) “ (1 “ 


N—foo 


0 , 


where 

niP) = - - — -^ ( sine (/3c/2)^ -f sine ((/? - a)c/2 f 

1 — Sine (ac/z) y 

—2 sine {acl2) sine (/?c/2) sine ((/3 — a)c/2)^ 

is such that k{(3) < 1 with equality if and only if (3 = 0 or 
j3 = a. 


Proof The two convergences can be easily obtained from 
(45). It thus remains to establish that n(/ 3) < 1 with equality 
if and only if /3 = 0 or /3 = a. Consider the Hilbert space 
([0,1]) endowed with the usual scalar product < Zi,Z 2 >= 
fg Zi(t)z 2 (t)*dt, and let xi,X 2 ,y € ([0,1]) defined by 

a;i(f) = 1, X2(t) = e‘“°* and y(t) = 

Straightforward computations show that k(/ 3) coincides with 
the squared norm of the orthogonal projection of y onto 
spanjcci, a;2}. Since y is unit-norm, it is clear that k{/3) < 1, 
and the equality holds if and only if y € spanjxi, X2}, which 
is obviously the case if and only if /? = 0 or /3 = a. □ 


From Lemma 1, the function k admits a global maximum, 
equal to 1, at the unique points 0 and a and 


sup 

"2 


m (6'i,tv + ;^ 1 “ (1 “ 


N—¥(X) 


0. 


Thus, 


VN = I — K (^N{9i^n — 0l,N)j + 0(1), 
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and since 7]n [Oi^nJ 0 a.s., we deduce that N{9i^n — 

^i,n) We obtain similarly the same results for ^2,iv- 

We now consider the consistency of the traditional MUSIC 
estimates. From (39), 


sup 

[ —TTjTt] 


V'n 


(t), 


AT—>-oo 


0 , 


where = 1 — a(0)*UArDU^a(0). From Assumption 

3, N-^SnS%^1, and using the fact that 


A* A 


N- 


1 e 

Q-iacjl [acl2) 


sine (ac/2)' 
1 


together with a singular value decomposition of A, straight¬ 
forward computations yield 


sup 

e 




(t). 


N—¥(X) 


0 , 


where = 1 — a(0)*AVDV*A*a(6l) and where V is 

2x2 unitary matrix given by 


V = 


1 

Vi 


1 

_p-iac/2 


giQc/2' 

1 ’ 


and D is a 2 X 2 diagonal matrix defined by 


D = 


dlja) 

1—sirLc(ac/2) 

0 


0 

dlja) 

l-t-sinc(ac/2) 


with 


. / i ^ _ (1- |smc(ac/2)|)^-g-^c _ 

^ {I — \ sinc(ac/2)|) (1 — | sinc(ac/2)| + a^c) 

, . _ (1 + 1 sinc(ac/2)|)^ - 

^ (1 + 1 sinc(ac/2)|) (1 + | sinc(Q;c/2)| -f a^c) 


We now use the following result, whose proof is similar to the 
one of Lemma 1. 


Lemma 2. If {iPn) is a sequence of [—7r,7r] such that 
N I'i/^Tv — ^i,tv| oo, then 


Vn\'^n) 


-^ 1 . 

N—^-oo 


Moreover, for any compact /C C K. 


sup 

8eic 




-4 0. 


where 


At(‘)(/3) = 


(sinc(/3c/2) — sine ((/3 — 
+ (sinc(/3c/2) + sine ((/3 


a)c/2)f 


di{a) 


-a)c/2)) 


2 (1 — I sine(ac/2)|) 
2 d2{ct) 


2(1 


sine ac 


/ 2 )|)' 


Function does not admit in general a local maximum 
at 0 or a. In effect, it is easy to find values of a for which 
and are not local maxima of function k^K For 

example, if a = -, we easily check that (/3) f 0 for 
j3 = 0 and {3 = a. 


From Lemma 2, we have with probability one, 

{^[%) = 1 - {n - 01 ,^)) + 0 ( 1 ). 

Assume N ~ 0- Then —>■ 1 — 

If 0 and a are not local maxima of K^f let /3 G 
such that and (i/'w) a se¬ 

quence such that N {ipN — 0 i,n) -8- /?. Then 

limsupp^^ ^ limsupp^^ (i/'jv) 

N—^oo ^ ' N—foo 

= 1-k^*\/3) 

which is a contradiction. 


Appendix D 
Proof of Theorem 7 


To prove Theorem 7, we will use the classical A-method, 
as in e.g. Hachem et al. [7]. 

We consider the settings of Assumption 2 or Assumption 
3, and make appear the dependence in N for the Do A in 
both scenarios, which we denote by 0i,Ar,..., 9k,n- Let k = 
1,..., A. Using Theorem 5 under Assumption 2 (respectively 
Theorem 6 under Assumption 3), as well as a Taylor expansion 
around 9k, n, we obtain 


Vn {9k,= Vn {9k,N) + {9k,N — 9k,N^ Vn'^ i9k,N) 


+ 


-Vn 




where 

Since 


{9k,N — 9k,N , 

9k,N € ^min 0fc,Ar| , max 
by definition, pjy {9k,= 0, we obtain 

V'n idk,N) 


7k,N 


7k,N = 


idk,N) 


^k,N—^k,N .^(3) 

2 9n 


{9k, 


As the j-th derivative aL7(0) satisfies sup^ ||aL7(6))| 
we deduce from [6] that ® 

(0\n) =0(1) 


A3 


Mf 

(47) 


with probability one. Theorem 5 implies 

{9k,N^ 


{9k,N — 9k, 


-(a) 

Vn 


iV2 


N—^oo 


0 , 


,/kVn {dk,N) 


(48) 


and we obtain 

{9k,N — 9k,N^ = — - C2'| 

^ ^ mVN idk,N) + Op{l) 

By using (15) and the fact that nAra(0fc) = 0, we can write 

1 -'(2) ra \ o^'(^fcw)*TT a'(^fcw) , 

-^vV i^k,N) = 2—-—- - -+ Op(l) 


^The boundedness (47) can be obtained using the techniques developed in 
the proof of [6, Th. 3.1] (see also equation (1.3) in the introduction part of 
this reference). 
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Under Assumption 2, the basic convergences A* A —> I, as 
A —> oo, as well as 


1 

N 


3-'{0k,N) 


2 


N- 


3 


and 


1 

N 


^ {Ok,NT^{0l,N) 


-S> 

N—^oo 


4 


Sk,e 


prove that 


[ 1 ] 

[ 2 ] 

[3] 

[4] 

[5] 


a.'{9k,N)* „ ^{0k,N) 

iijv 


N 


N 


-^ TA > 0- 

N—^od 12 


[ 6 ] 


Under Assumption 3, we use the arguments in the proof of 
Lemma 1. Indeed, let xi,X 2 ,y & ([0,1]) defined by 

Xi{t) = l,X 2 {t) = e‘“°* and y(t) = ict. 

Then, we observe that converges to 

the squared norm of the orthogonal projection of y onto 
spanjaii,Thus, we deduce again that 


Al—foo A 


A 


set 


, a'( 0 fc at) . (Q \ 

di,jv = —— and d 2 ,Ar = a[9k,N)- 


Obviously, 


[7] 

[ 8 ] 

[9] 

[ 10 ] 

[ 11 ] 


Consider now the quantity jn introduced in (17), where we ^2] 


In > 


N- 


E 


^4(A2-a4c) 


|a(^*fc,Ar)*Uf,Ar| 


^ ^a'i0k,N)*^ a'{9k,N) 
where D = min ^ ^ - 


{ : ^ = 1, • ■ •, a} > 0. Therefore, 

under Assumption 2 or Assumption 3, we obtain 


liminf nn > 0. 

tV->oo 


Since 

Vn {9k, n) = 

2ARe 


a'{9k,N)* (f 1 . ^ 

-- p- “ ~Y~' - \^k,NU^. pf a{9k,N) 

y k=i h lXk,N) J J 


[13] 

[14] 

[15] 

[16] 

[17] 

[18] 

[19] 

[ 20 ] 

[ 21 ] 

[ 22 ] 


Theorem 3 applied with di^jv = d2,Ar = a{9k,N) 

gives 
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7jv {9k, n) 


V 


N- 


>A/r(0,1), 


Gathering this convergence with (48), we eventually obtain 

(31). 



